Papers with dialogue summarization
Copied to clipboard
| Challenge: | Existing methods for dialogue summarization consider roles separately where interactions among different roles are not fully explored. |
| Approach: | They propose a novel role-aware centrality model to capture role interactions by involving role prompts to control what kind of summary to generate. |
| Outcome: | The proposed model achieves state-of-the-art on two public benchmark datasets, CSDS and MC. |
Copied to clipboard
| Challenge: | Existing methods for low-resource dialogue summarization neglect the difference between dialogues and conventional articles. |
| Approach: | They propose a multi-source pretraining paradigm to leverage external summary data . they exploit large-scale in-domain non-summary data to separate dialogue encoder and summary decoder . |
| Outcome: | The proposed model can be used to better leverage external summary data. |
Copied to clipboard
| Challenge: | Experimental results show that our proposed framework generates fluent and factually consistent summaries under various planning controls using both objective metrics and human evaluations. |
| Approach: | They propose a controllable neural generation framework that can guide dialogue summarization with personal named entity planning. |
| Outcome: | The proposed framework generates fluent and factually consistent summaries under various planning controls using objective metrics and human evaluations. |
Copied to clipboard
| Challenge: | Recent advances in summarization provide models that can generate high quality summaries . a new toolkit for summarizing text is being developed to make it easier for non-experts to keep track of them. |
| Approach: | They develop a toolkit for text summarization that integrates with libraries designed for NLP researchers. |
| Outcome: | SummerTime is a toolkit for text summarization, including models, datasets, and evaluation metrics. |
Copied to clipboard
| Challenge: | Existing approaches to dialogue summarization rely on features of conversation data. |
| Approach: | They propose to use natural language inference models to improve coverage and faithfulness . they use fine-grained training signals to encourage model to generate missing content . |
| Outcome: | The proposed model achieves higher faithfulness and coverage while maintaining conciseness compared to prior methods. |
Copied to clipboard
| Challenge: | Existing few-shot dialogue state tracking (DST) methods transfer knowledge from labeled data into DST, but collecting large amount of labeles is laborious. |
| Approach: | They propose a few-shot dialogue state tracking framework that integrates self-training and self-supervised learning methods into the framework. |
| Outcome: | The proposed framework achieves competitive performance in several few-shot scenarios. |
Copied to clipboard
| Challenge: | Existing research is limited by general or niche datasets that lack sufficient scale for training dialogue systems. |
| Approach: | They propose a synthetic dialogue generation framework that uses Large Language Models and Chain of Thought reasoning to generate dynamic, domain-specific dialogues with simulated personas and diverse conversational features. |
| Outcome: | The proposed framework outperforms existing frameworks on dialogue summarization and quality increases as the size of the LLM increases from 3B to 8B. |
Copied to clipboard
| Challenge: | Existing methods for summarizing dialogues lack in taking into account the structure of dialogues and rely heavily on labeled data. |
| Approach: | They propose a pre-trained encoder-decoder model for summarizing dialogues in any new domain. |
| Outcome: | The proposed model outperforms existing methods on six datasets and shows ROUGE scores in zero-shot and few-shot settings. |
Copied to clipboard
| Challenge: | a recent study shows that multimodal summarization is not efficient for long inputs and outputs. |
| Approach: | They extend a TV episode transcript summarization dataset and create a multimodal variant by collecting full-length videos. |
| Outcome: | The proposed model can be tuned to perform multimodal summarization tasks efficiently using adapter modules augmented with a hierarchical structure while tuning only 3.8% of model parameters. |
Copied to clipboard
| Challenge: | Health wellness agents typically rely on large language models (LLMs) for response generation, where contextual information from prior conversations can be utilized for response grounding and personalization. |
| Approach: | They propose to use large language models to generate high-quality health dialogue summaries by using iterative feedback. |
| Outcome: | The proposed method outperforms baseline on open-source and proprietary benchmarks and can run on local compute without a GPU. |
Copied to clipboard
| Challenge: | Existing dialogue summarization systems encode text with a number of general semantic features, but these are often not available in open-domain tools. |
| Approach: | They propose to use DialoGPT to label three types of features on two datasets . they propose to employ pre-trained and non-pre-tried models as dialogue annotators . |
| Outcome: | The proposed method improves on two dialogue summarization datasets and achieves state-of-the-art performance. |
Copied to clipboard
| Challenge: | Existing approaches to dialogue summarization use dialogue-specific features that require additional knowledge to recognize or make the models harder to tune. |
| Approach: | They propose to post-train pretrained language models to rephrase from dialogue to narratives and fine-tune them as usual. |
| Outcome: | The proposed approach outperforms existing models by summary quality and implementation costs. |
Copied to clipboard
| Challenge: | Existing prompt transfer techniques lack consideration for dialogue-specific information. |
| Approach: | They propose a method which leverages skeleton generation as extra supervision that functions as a medium connecting the distinct source and target task. |
| Outcome: | The proposed method significantly outperforms baselines on two dialogue summarization benchmarks. |
Copied to clipboard
| Challenge: | DialogStudio is the largest and most diverse collection of dialogue datasets . existing datasets lack diversity and comprehensiveness, authors say . |
| Approach: | They introduce DialogStudio: the largest and most diverse collection of dialogue datasets . DialogStuio aggregates more than 80 diverse dialogue dataset . |
| Outcome: | a new dataset is created to improve the quality and diversity of dialogue datasets . DialogStudio is the largest and most diverse collection of dialogue data . |
Copied to clipboard
| Challenge: | Existing methods for role-oriented dialogue summarization ignore information from other roles, resulting in omitted information. |
| Approach: | They propose a novel method that uses cross attention and decoder self-attention interactions to acquire other roles' critical information. |
| Outcome: | The proposed method significantly outperforms baselines on two public role-oriented dialogue summarization datasets. |
Copied to clipboard
| Challenge: | Existing methods to summarize text data are limited by the lack of data. |
| Approach: | They propose a method that uses external data to generate synthetic dialogues from short texts containing people and their interpersonal interactions. |
| Outcome: | The proposed method shows robust performance, generalizability, and scalability regardless of complexity of dialogues. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have introduced paradigm-shifting approaches in natural language processing, yet their transformative in-context learning (ICL) capabilities remain underutilized, especially in customer service dialogue summarization. |
| Approach: | They propose a single-instance, multi-step framework that orchestrates information extraction, self-correction, and evaluation through sequential interactive generation chains. |
| Outcome: | The proposed framework outperforms existing models and prompts in the customer service dialogue summarization domain. |
Copied to clipboard
| Challenge: | Existing LLMs hallucinate significant amounts of factual errors in the dialogue domain, regardless of the model’s size. |
| Approach: | They propose to evaluate topic-focused dialogue summarization by using large language models (LLMs) they use human annotations to evaluate factual consistency and explain factually inconsistent sentences. |
| Outcome: | The proposed evaluation benchmark on topic-focused dialogue summarization shows that existing LLMs hallucinate significant amounts of factual errors regardless of the model’s size. |
Copied to clipboard
| Challenge: | Recent work on dialogue summarization models focuses on generating concise summaries for multi-party dialogues. |
| Approach: | They propose several ways to convert dialogue into a third-person narrative style . they propose to use narration as a valuable annotation for LLMs . |
| Outcome: | Empirical results show that the proposed approach achieves higher scores on ROUGE and a factual correctness metric. |
Copied to clipboard
| Challenge: | Recent advances in deep learning have improved the performance of abstractive summarization systems. |
| Approach: | They present a dataset of french political debates to enhance resources for multi-lingual dialogue summarization. |
| Outcome: | The proposed dataset will be made publicly available for use by the research community. |
Copied to clipboard
| Challenge: | Existing models focus more on the structure of summary, not on the personal and logical inconsistency problem. |
| Approach: | They propose a model to solve the problem of personal and logical inconsistency . they use an utterance rewriter to complete the ellipsis content of dialogue content . |
| Outcome: | The proposed model outperforms baseline models on both SAMSum and DialSum datasets. |
Copied to clipboard
| Challenge: | Existing models generate fluent and coherent summaries, but inconsistencies can be found in generated summary. |
| Approach: | They propose to use symbolic knowledge distillation to improve the factual consistency of smaller pretrained models for dialogue summarization. |
| Outcome: | The proposed model outperforms baseline models in BART, PEGASUS, and Flan-T5 in factual consistency and accuracy. |
Copied to clipboard
| Challenge: | Existing studies on faithfulness of text summarization have not been conducted on abstractive summarizing. |
| Approach: | They propose a method to evaluate faithfulness of dialogue summarization models by multi-choice questions. |
| Outcome: | The proposed method can facilitate the development of dialogue summarization systems. |
Copied to clipboard
| Challenge: | Existing methods for abstractive summarization use encoder-decoder attention, but this leads to incomplete copying. |
| Approach: | They propose a copying scheme that takes advantage of prior copying distributions and explicitly encourages the model to copy the input word that is relevant to the previously copied one. |
| Outcome: | The proposed scheme achieves state-of-the-art on summarization benchmarks . it takes advantage of prior copying distributions and explicitly encourages copying . |
Copied to clipboard
| Challenge: | LLMs generate responses following user's instructions, which requires high dialogue comprehension ability. |
| Approach: | They propose to evaluate LLMs' dialogue comprehension ability using a dialogue summarization task to derive factual questions from the generated summaries and use them as a more flexible measurement of dialogue comprehension. |
| Outcome: | The proposed model reduces the error rate by 11% on the dialogue summarization task. |
Copied to clipboard
| Challenge: | Existing models that deal with multiple topics are prone to topic drift . experimental results show that our model outperforms state-of-the-art methods on ROUGE scores . |
| Approach: | They propose a dialogue summarization model that reflects dialogue topic distribution to consider all topics present in a dialog. |
| Outcome: | The proposed model outperforms state-of-the-art methods on ROUGE scores and generates comprehensive summaries. |
Copied to clipboard
| Challenge: | Pre-trained language models have established the state-of-the-art on various natural language processing tasks, including dialogue summarization. |
| Approach: | They propose to use several language specific pre-trained models to summarize spontaneous oral dialogues in French using several language-specific pre-trainers: BARThez, BelGPT-2, mBARThes, and mT5. |
| Outcome: | The proposed models outperform the existing models on the DECODA (Call Center) dialogue corpus and show that they are far superior to the current models. |
Copied to clipboard
| Challenge: | Existing studies for dialogue summarization use one model at a time or treat it as a black box. |
| Approach: | They propose an LLM-based approach with role-oriented routing and fusion generation to utilize mixture of experts for dialogue summarization. |
| Outcome: | The proposed approach produces informative and accurate dialogue summarization on widely used datasets. |
Copied to clipboard
| Challenge: | Empirical results demonstrate that our method improves dialogue summarization, achieving a 1.5% increase in ROUGE scores and a 0.3% improvement in BERT scores in few-shot settings. |
| Approach: | They propose Mutual Reinforcing Data Synthesis (MRDS) within large language models to enhance few-shot dialogue summarization task. |
| Outcome: | Empirical results show that the proposed method improves dialogue summarization, achieving a 1.5% increase in ROUGE scores and a 0.3% improvement in BERT scores in few-shot settings. |
Copied to clipboard
| Challenge: | Experimental results show unique challenges in dialogue summarization such as spoken terms, special discourse structures, coreferences and ellipsis, pragmatics and social common sense. |
| Approach: | They propose a large-scale labeled dialogue summarization dataset . they use state-of-the-art neural models to analyze spoken dialogue summaries . |
| Outcome: | The proposed dataset can be used to analyze spoken dialogue summarization challenges. |
Copied to clipboard
| Challenge: | Existing methods for dialogue summarization only apply to specific scenarios and domains. |
| Approach: | They propose a pre-trained model specifically designed for multi-scenario multi-domain dialogue summarization. |
| Outcome: | The proposed model significantly outperforms state-of-the-art models on three dialogue summarization datasets from different scenarios and domains. |
Copied to clipboard
| Challenge: | Existing methods to learn vital information from dialogue context with limited data are limited due to limited words in utterances and huge gap between dialogue and its summary. |
| Approach: | They propose an unsupervised strategy to learn vital information from dialogue context . the proposed model uses a hypothetical foundation that a superior summary approximates a replacement of the original dialogue . |
| Outcome: | The proposed model outperforms existing models on a number of datasets. |
Copied to clipboard
| Challenge: | Existing datasets for dialogue summarization are limited to their small sizes and are built from a narrow domain. |
| Approach: | They propose a large-scale media interview dataset consisting of 463.6K transcripts with abstractive summaries. |
| Outcome: | The proposed dataset is larger and contains multi-party conversations from multiple domains. |
Copied to clipboard
| Challenge: | Conventional dialogue summarization methods generate summaries without considering user’s specific interests. |
| Approach: | They propose a three-step approach to synthesize high-quality query-based summarization triples by training a unified model on three summarizing datasets with multi-purpose instructive triples. |
| Outcome: | The proposed model outperforms state-of-the-art models and even models with larger sizes on four datasets including dialogue summarization and dialogue reading comprehension. |
Copied to clipboard
| Challenge: | Existing models for dialogue summarization focus on document summarizing on time and speaker-centered points, but this approach is limited in understanding the dialogue. |
| Approach: | They propose a 2D view of dialogue based on a time-speaker perspective where the time and speaker streams of dialogue can be obtained as strengthened input. |
| Outcome: | The proposed model outperforms existing models on the QMSum dataset and improves summary faithfulness and human evaluation. |
Copied to clipboard
| Challenge: | Existing summarization systems based on pre-trained models cannot recognize the unique format of the speaker-utterance pair well in the dialogue. |
| Approach: | They propose three speaker-aware supervised contrastive learning tasks to solve the speaker identification problem in dialogue summarization task. |
| Outcome: | The proposed methods improve on two mainstream dialogue summarization datasets. |
Copied to clipboard
| Challenge: | Recent development of large language models (LLMs) have boosted interest on dialogue agents . however, research on these tasks is limited by the insufficiency of public datasets . stance detection and debate summarization are key for engaging argumentative dialogues - but are not available for non-English languages. |
| Approach: | They propose to use ORCHID to benchmark stance detection and debate summarization in Chinese debates. |
| Outcome: | The proposed task is based on 1,218 real-world debates conducted in Chinese on 476 unique topics. |
Copied to clipboard
| Challenge: | Recent advances in large language models have improved summarization, but they still face a challenge of hallucination. |
| Approach: | They propose a taxonomy of errors to address the problem of hallucination in LLMs . they propose two prompt-based approaches for fine-grained error detection . |
| Outcome: | The proposed model outperforms existing metrics in identifying the novel "Contextual Inference" error type. |
Copied to clipboard
| Challenge: | Current evaluations of FEC models that depend on factuality metrics are not reliable and detailed enough. |
| Approach: | They propose a fine-grained evaluation framework that automatically evaluates FEC models on different error categories. |
| Outcome: | The proposed evaluation framework compares models on different error categories and finds the best training modes and significant differences in the performance of existing models. |
Copied to clipboard
| Challenge: | Existing methods for encoding dialogues do not capture interaction information between roles, thus ignore interaction-related key information. |
| Approach: | They propose a contrastive learning based interaction-aware model for the role-oriented dialogue summarization namely CIAM and use it to train the decoder to learn role-level interaction. |
| Outcome: | The proposed model captures interaction information between different roles and produces informative summaries on two public datasets. |
Copied to clipboard
| Challenge: | Existing methods for dialogue summarization are far from satisfactory . omission is a major factor in affecting the quality of summarizing, but few studies have explored the problem . |
| Approach: | They propose a dataset that provides high-quality omission labels for dialogue summarization . they propose to use this dataset to detect omitted dialogue utterances . |
| Outcome: | The proposed dataset improves summarization quality by providing ground-truth omission labels . the proposed dataset and codes are publicly available . |
Copied to clipboard
| Challenge: | Existing discourse parsing approaches are constrained by predefined relation types, which can impede the adaptability of the parser for downstream tasks. |
| Approach: | They propose to introduce a task-aware paradigm to improve the versatility of the parser. |
| Outcome: | Empirical studies on dialogue discourse parsing datasets and a downstream task demonstrate the proposed framework. |
Copied to clipboard
| Challenge: | Summarizing the dialogue into a short message has drawn much attention due to the explosion of various dialogue scenes. |
| Approach: | They develop a multi-modal dialogue summarization dataset to enhance the variety of data available for this research area. |
| Outcome: | The proposed dataset provides a demanding testbed for multi-modal dialogue summarization. |
Copied to clipboard
| Challenge: | a low-resource natural language generation task requires a large number of examples to generate outputs and outputs. |
| Approach: | They propose a teacher-student pipeline that synthesizes accurate input–output pairs without human labels or parallel data. |
| Outcome: | The proposed pipeline synthesizes accurate input–output pairs without human labels or parallel data. |
Copied to clipboard
| Challenge: | Existing methods for multi-role dialogue summarization favor surface-level imitation of references rather than genuine gains in faithfulness or alignment with human preferences. |
| Approach: | They propose a framework that couples explicit cognitive-style reasoning with reward-based optimization for multi-role dialogue summarization. |
| Outcome: | The proposed framework matches strong baselines on ROUGE and BERTScore, while in-depth analysis on SAMSum shows clear gains in factual faithfulness and model-based preference alignment. |
Copied to clipboard
| Challenge: | a growing number of recorded human speech is recorded for automated processing, resulting in errors in the transcripts . a configurable framework is proposed to analyze transcript noise impact across noise levels and transcript-cleaning techniques. |
| Approach: | They propose a configurable framework for assessing task models in diverse noisy settings . framework facilitates investigation of task model behavior, which can support effective SLU solutions. |
| Outcome: | The proposed framework can analyze model behavior in various noise levels and transcript-cleaning techniques. |